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9 a global video Ws which routes the video data between said processing 

10 module and said at least We video processing module; and 

1 1 a global control biis which provides said control data to/from said 

12 processing module from/to slaid at least one video processing module , said global 

13 control bus being separate from said [video data on said] global video bus. 

1 2. (Amended) ThV system of claim 1, wherein said video data is 

2 coupled with associated video tiniing signals [information] synchronized to a system 

3 clock signal , and each video procesising module comprises a crosspoint switch 

4 which routes said video data and its^ssociated video timing signals [information] 

5 to/from respective ones of the p arallel pipelined video hardware components, said 

6 timing [data] signals indicating when tW video data represents active video 
information [compensating for pipeline aelay in said video processing module]. 



1 y!r. (Amended) The system of claim 2, wherein each video processmg 

2 module further comprises a crosspoint switch state machine which monitors 

3 transfers of video data over each data path of said crosspoint switch and facilitates 

4 [selection of idle data] allocating paths for [each transfer of data from one] 

5 transferring the video data among the parallel pipelined video hardware [component 

6 to another] components . 

pl * 4. (Amended) The system of claim 2, wherein at least one video 

2 processing module comprises ^configurable aridimetic logic unit (CALU) 

3 responsive to said video data ana its associated video timing [information] signals 

4 so as to automatically compensate for differences in input video timing between 

5 respective images and to provide qual image pointwise video processing operations 

6 and image accumulations. 

1 5. (Amended) The sy^em of claim 2, wherein at least one video 

2 processing module comprises at least ®ne pyramid filtering processor which 

3 generates [pyramid] spatially filtered representations of the video data at 

4 respectively different resolutions so as to facilitate real-time processing of said 



3 
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video data [for said particular image processing tasks of said video processing 
system] . 

6. (Amended) \he system of claim 2, wherein the modular video 
processing system includes a plufality of video processing modules and each video 
processing module comprises a connection for at least one daughterboard [which 
performs a video processing function on said video data which is unique to 
particular image processing tasks of said video processing system] the connection 
including means for routing at least a portion of the control data between the 
processing module and the daughterboat^ and for coupling the daughterboard to the 

\^ if 

(Amended) The system of claim p, [wherein said at least one] 
further including a daughterboard [comprises] comprising a display processor card 
coupled to the daughterboard connection of one of the plurality of video processing 
modules, the display processor card including video input [and output] ports 
connected to said crosspoint switch and an encoder which converts video data 
received at [an] at least one of the input [port] ports into a video signal of a 
predetermined format for display. 

17 13 

(Amended) The system of claim [wherein said at least one] 

further including a daughterboard [comprises] comprising a digitizer card coupled 
to the daughterboard connection of one of the plurality of video processing 
modules, the digitizer card including video [input and] output ports connected to 
said crosspoint switch and a decoder which decodes and digitizes video data 
received at [an] at least one input port into a video signal of a predetermined format 
[for further processing so as to provide an input and output interface for digital 
video] and provides the digitized video data to at least one of the output ports . 

\S 15 

(Amended) The system of claim [wherein said at least one] 

further including a daughterboard [comprises] comprising a correlator card coupled 
to the daughterboard connection of one of the plurality of video processing 
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4 modules, the correlator card including a plurality of video input and output ports 

5 connected to said crosspoint switch and a plurality of video processing channels, 

6 each channel comprising a configurable arithmetic logic unit, a pyramid filtering 

7 processor, and a look up table [which correlate respective images in each video 

8 processing channel in a predetermined manner] . 

1 (Amended) The system of claim A [wherein said at least one] 

2 further including a daughterboard [comprises] comprising a warper card coupled to 

3 the daughterboard connection of one of the plurality of video processing modules, 

4 the warper card including video input and output ports connected to said crosspoint 

5 switch^ [and an address generator and] a pair of memory banks , an address 

6 generator, for controlling memory read operations and memory write operations in 

7 the memory banks, and a bilinear interpolator [for parametric transformation of 

8 video data received at an input port] . 

1 yC. (Amended) The system of claim [6] i^f, wherein said [at least one 

2 daughterboard comprises a warper card including a plurality of video input and 

3 output ports connected to said crosspoint switch, a pair of memory banks, and a 

4 plurality of] address generator and said bilinear interpolator are implemented as at 

5 least one field progranmaable gate array [arrays programmed so as to provide 

6 parametric transformation of video data received at said input ports] . 



-(Amengfed) The system of claim 1, wherein said processing 



module coipprrgesat least tWo microprocessors each of which has an associated 
rarjdolnaccess memory which rs not shared with any other microprocessor, [and] 
said processing module further comprising a shared memory which is accessible by 
each microprocessor of said processorsmodule through an arbitrated control bus 
which arbitrates requests for access to sakj shared memory from each 
microprocessor. 

13. (Amended) The ^stem of claim 12, wherein said processing 
module includes means for using th^ control data to program the at least one video 
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3 processing module to perforifk at least one of the different video processing 

4 operations on the video data and means for providing a [provides at least one] 

5 synchronous start signal to begin the at least one video processing operation [for 

6 each different video processing operation of each video processing module]. 



6 

\ (Amended) The system of claim wherem said processmg 

2 module further comprises a communications [devices] interface for communicating 

3 with external devices, said communications [devices] interface being [accessed by 

4 each of said microprocessors via] coupled to said arbitrated control bus for access 

5 by each of said at least two microprocessors . 

(Amended) The system of claim wherein said random access 

2 memory associated with each microprocessor is connected to said global video bus 

3 [and stores] to store video data for transmission to, and [stores] video data received 

4 from [said at least one video processing module over] said global video bus. 

1 >D. (Amended) The system of claim wherein said processor 

2 module further comprises a semaphore register [available to each microprocessor 

3 via] coupled to said arbitrated control bus, said semaphore register storing 

4 semaphores so as to facilitate coordination o£[and mutual exclusion of] mutually 

5 exclusive operations by said at least two microprocessors. 





mded) The system of claim 1, further comprising a hardware 
control^^JMary loaded oh^ general purpose microprocessor of said processing 

said hardware conbrol library comprising a set of functions for 
programming the parallel pipelined video hardware of said at least one video 
processing module to perform [prfe(tetermined] respective ones of said different 
video processing operations concurreh<Jy . 



(Amended) The system of claim }Pf, wherein said processing 
module comprises at least two general purpose microprocessors and said hardware 
control library further comprises a set of functions for coordinating concurrent 
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4 multitask processing operations of said at least two general purpose 

5 microprocessors. 

I 1 19. (Anlended) The system of claim 17, wherein said control data 

' 2 comprises [video device information] respective control signals for each hardware 

3 component of said vicreo processing system, wherein said functions of said 

4 hardware control librae manipulate said [video device information] control signals 

5 to program said hardware components for each of said different video processing 

6 operations. \ 

1 20. (Amendedx A method of creating a modular video processing 

2 system, comprising the stepB of: 

3 providing video data Via a global video bus; 

4 providing a global control bus; 

5 connecting [to a global! control bus] a processing module containing at least 

6 one general purpose microproaessor to said global video bus and said global control 

7 bus [which controls] said microprocessor controlling hardware and software 

8 [operation] operations of said viueo processing system using control data and 

9 processing said video data ; \ 

10 connecting to said global cWtrol bus and said global video bus to at least 

I I one video processing module whicn contains parallel pipelined video hardware 

12 [which is progranunable by] that isVesponsive to said control data to provide 

13 different video processing operations on [an input stream of] the video data; 

14 wherein said processing modiffle [detecting] detects the presence of each 

15 video processing module connected to\said global control bus; and [said processing 

16 module passing] passes said control data to each detected video processing module 

17 over said global control bus to prograni said parallel pipelined video hardware to 

18 perform [a video processing function wmich is unique to particular processing tasks 

19 of said video processing system] at least\one of said video processing operations . 
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21. (Amended)\ The method of claim 20, comprising the additional 
steps of [coupling to a global video bus said video data with] connecting the 
hardware components of the processing jupdule to a crosspoint switch and 
providing associated video timing [WormM signals with the video data, said 
video timing signals being synchromzbd tij/a system clock signal , and routing said 
video data and [its] associated video timW [information] signals to/from respective 
parallel pipelined video hardware con[i£on^i^^6f said video processing module over 
said global video bus via [a] the crosspoint swteh, said timing signals indicating 
when the video data represents active video information [data compensating for 
pipeline delay in said video processing module]. 



22. (Amended)-^SThe method of claim 21, comprising the additional 
''^tep of [said propessihg module! providing at least one synchronous start signal [to 
^fp each dete^cte'cf video processing nihdule over] via said global control bus said 
4 synchronous start signal being coupled to the processing module and to the at least 
5 ^-"' one video processing module to signal\]he start of the at least one video processing 
6 operation . 



1 23. (Amended) The method of claim 22, comprising the additional 

2 step of coupling a semaphore register to the processing module said semaphore 

3 register being configured to coordinate [coordinating] multitask processing 

4 operations when said processing module comprises at least two general purpose 

5 microprocessors. 




-24. 
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The method of claim 21, comprising the additional 
steps of conpeetiii^a crosspb^nt state machine to said crosspoint switch, said 
crogspdint state machine monitb^ ing transfers of video data over each data path of 
said crosspoint switch and [facilitating selection of idle data] allocating paths for 
[each transfer of data from one] transferring the video data among the parallel 
pipelined video hardware [component t\another] components . 
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25. (Amended) The method of claim 21 , wherein said control data 
comprises [video device information] respective control signals for each hardware 
component of said vifleo processing system, [comprising the further step of said] 
the method including me step of coupling said processing module [manipulating] to 
manipulate said [video device information] control signals to program said 
hardware components foneach of said different video processing operations. 

26. (Amended)\ The method of claim [21] 22, comprising the steps of 
configuring the video processing module to automatically [compensating] 
compensate for differences in\input video timing between respective [images] 
combinations of video data and video timing signals provided by said crosspoint 
switch and [providing] to provifle dual image pointwise video processing operations 
and image accumulations of saidVespective images. 

27. rAnended^i A modular processing system comprising: 




at le^st^me specialized processing module which contains parallel 
pipelin^d^Iiardware [which] that is progranmiable to provide different specialized 
gj:o€essing operations on a^ input stream of data; 

a general processin^module containing a general purpose microprocessor 
which controls hardware and sWtware operation of said specialized processing 
module and said general processrgg module, using a hardware control library 
loaded on said general purpose microprocessor, said hardware control library 
comprising a set of functions for progranmiing said parallel pipelined hardware of 
said at least one specialized processingViodule and said microprocessor of said 
general processing module to perform predetermined specialized processing 
operations on the input stream of data ; and 

a global control bus which provides c\)ntrol data to/from said hardware 
control library of said general processing modulk from/to said at least one 
specialized processing module separate from said stjeam of input data to be 



